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SPECIFICATION <EXCERPT> 

[0029] 

Fig. 1 is a block diagram showing an example of a configuration 
of the device. In Fig. 1, a reference numeral 1 designates a device 
main body, 2 designates a removably attached audio/image 
processor, and 3 designates a system controller including a CPU, a 
memory, a timer and so on, provided for controlling the entire 
device. 

[0033] 

Fig. 2 shows an example of a configuration of the audio/image 
processor 2 for use as an application of a digital still camera. In Fig. 
2, a numeral 100 designates the same processor as the audio/image 
processor 2 shown in Fig. 1. A numeral 101 designates an image 
codec including an exclusive LSI for encoding and decoding digital 
image data in compliance with the ISO Standard JPEG baseline 
format. A numeral 102 designates a recording medium interface 
unit including a memory card controller or the like, provided for 
establishing an interface with a recording medium. A numeral 103 
designates a recording medium including a flash memory, for storing 
compressed image signals and various information on images. 
[0034] 

Fig. 3 shows an example of a configuration of the audio/image 
processor 2 for use as an application of a TV phone. In Fig. 3, a 
numeral 200 designates the same processor as the audio/image 
processor 2 shown in Fig. 1, 201 designates a scaler including an 
exclusive LSI provided for scaling up and down the digital image 
data, 202 designates an image codec including an exclusive LSI 
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provided for encoding and decoding the digital image data in 
compliance with the TU-T Recommendation H.263, 203 designates 
an eco canceller provided for cancelling an eco of the digital audio 
data, 204 designates a sound codec including an exclusive LSI 
provided for encoding and decoding digital audio data in 
compliance with the ITU-T Recommendation G.723, 205 designates 
a communication control unit including a communication controller 
or the like, provided for multiplexing and controlling the protocol of 
the data in compliance with the ITU-T Recommendation H.324, and 
for executing data communication with a mobile phone, and 206 
designates an interface line with the mobile phone. 
[0035] 

Regarding other examples, a table 1 given hereunder shows 
respectively corresponding functions. The digital still camera 1 in 
table 1 corresponds to Fig. 2, and the TV phone corresponds to Fig. 
3. 

[0036] 



[Table 1] 



^\FUNCTION 
APPLICATIOTJ\ 


IMAGE 

SIGNAL 

PROCESSING 


AUDIO SIGNAL 
PROCESSING 


RECORDING 

MEDIUM/ 

COMMUNICATION 


VOICE 
RECORDER 


N/A 


ADPCM CODEC 


FLASH MEMORY 


MP3 PLAYER 


N/A 


MPEG AUDIO 
DECODER 


FLASH MEMORY 


DIGITAL STILL 
CAMERA 1 


JPEG CODEC 


N/A 


FLASH MEMORY 


DIGITAL STILL 
CAMERA 2 


JPEG2000 
CODEC 


N/A 


FLASH MEMORY 


DIGITAL STILL 
CAMERA 3 


JPEG2000 
CODEC 


N/A 


MOBILE PHONE 
I/F (MODEM) 
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PC CAMERA 


JPEG 

ENCODER 


N/A 


USB I/F 


mrtvj LAMtKA 


MPcijZ VIDcU 
CODEC 


ALJ CODEC 


HARD DISK 


TV PHONE 


H263 CODEC, 
SCALER 


G723 CODEC 
ECO 

PANPFI 1 FP 


MOBILE PHONE 
I/F (MODEM) 


FAX 


BINARY/ 
MULTI VALUE 
CONVERSION, 
MMR CODEC 


N/A 


MOBILE PHONE 
I/F (MODEM) 



[0037] 

Examples of the application/function shown in table 1 will be 
described hereunder. First, description will be given on an 
operation of the digital still camera application. 
[0038] 

Prior to shooting images, a user manipulates keys and dials 
(not shown) thereby determining a shooting mode (high-quality 
image mode, low-quality image mode, document shooting mode, 
and the like). The manipulation made by the user is recognized by 
the system controller 3 through the hard key interface unit 13, and 
the system controller 3 generates a guidance graphic in the display 
controller 11 in accordance with the manipulation, thus urging the 
user to proceed to a next step. 
[0039] 

The system controller 3 sets up, once the shooting mode is 
determined, a processing parameter based on the shooting mode, in 
the imaging controller 10. When a half-pressed state of a release 
button (not shown) is detected after the camera becomes ready for 
shooting, the half-pressing action is recognized by the system 
controller 3 through the hard key interface unit 13, as in the case of 
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determining the shooting mode. 
[0040] 

Prior to actual image shooting, the image pickup unit 8 starts 
picking up images for displaying a preview image, under control of 
the imaging controller 10. Data of images thus picked up is 
successively transmitted to the imaging processor 9, which executes 
processing such as color space conversion, gamma correction, and 
white balance adjustment, and then transmits the image data to the 
display controller 11. At the same time, the imaging controller 10 
detects a focusing and exposure status and controls the image 
pickup unit 8 for adjustment. 
[0041] 

The display controller 11 processes the image data signals and 
displays the image on the LCD 12, thus presenting the imaging 
status to the user. When the release button (not shown) is pressed, 
the pressing action is recognized by the system controller 3 through 
the hard key interface unit 13, in the same way as above. 
[0042] 

The image pickup unit 8 captures a predetermined image and 
transmits the image to the imaging processor 9 under the control of 
the imaging controller 10, and the imaging processor 9 processes 
the image in accordance with the shooting mode. The system 
controller 3 generates header information based on the shooting 
mode, and records the header information in the recording medium 
103, through the recording medium interface unit 102 in the image 
processing unit 2. Then the system controller 3 instructs the 
recording medium interface unit 102 to start writing the image data. 
[0043] 

The image data processed by the imaging processor 9 is 
sequentially transmitted to the image codec 101 in the audio/image 
processor 2, and the image codec 101 compresses the transmitted 
data in accordance with the ISO Standard JPEG baseline format. 



The compressed data is transmitted to the recording medium 
interface 102, and the recording medium interface 102 records the 
compressed image data in the recording medium 103, following the 
header information already recorded. 
[0044] 

Now, a reproducing operation will be described. The user 
manipulates keys and dials (not shown) to select a file to be 
reproduced. The manipulation made by the user is recognized by 
the system controller 3 through the hard key interface unit 13, and 
the system controller 3 generates a guidance graphic in the display 
controller 11 in accordance with the manipulation, thus urging the 
user to proceed to a next step. 
[0045] 

The system controller 3 reads out the header information from 
the recording medium 103 through the recording medium interface 
unit 102 in the audio/image processor 2, once the file to be 
reproduced is determined. The system controller 3 analyzes the 
header information and generates a guidance graphic in the display 
controller 11 in accordance with the header information, and 
displays the guidance graphic on the LCD 12. Then the system 
controller 3 instructs the recording medium interface unit 102 to 
start reading the image data. 
[0046] 

The recording medium interface 102 reads out the image data 
following the header information from the recording medium 103, 
and transmits the image data to the image codec 101. The image 
codec 101 expands the transmitted data in accordance with the ISO 
Standard JPEG baseline format, and sequentially transmits the 
expanded image data to the display controller 11. The display 
controller 11 once stores the image data in a display memory for 
changing magnification if necessary, and displays the image on the 
LCD 12. Thus, a series of reproducing operation is completed. 
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[0057] 

Fig. 4 shows a first example of operation. The system 
controller 3 is constantly monitoring an insertion status of the 
audio/image processor 2, in an activating stage of the device and 
while the device is at work (steps SI, S2). Detection of the 
insertion status is executed by an internal SW (not shown), and the 
status is recognized by the system controller 3 through the hard key 
interface unit 13. Upon detecting that the audio/image processor 2 
is inserted, the system controller 3 first supplies power to the 
audio/image processor 2 (step S3). The power supply can be 
executed by controlling a FETSW (not shown) through the hard key 
interface unit 13. 
[0058] 

Then the system controller 3 reads out a firmware of an 
application to be activated, from the audio/image processor 2 (step 
S4). Upon reading the firmware, the system controller 3 adds the 
application corresponding to the firmware that has been read, to the 
menu provided for the user for selection (step S5). In the case of 
the device according to claim 12, a power consumption parameter is 
also read at the same time as reading the firmware. Table 2 shows 
an example of the power consumption parameter. In the case of 
the device according to claim 11, a plurality of operation modes that 
reduces the power consumption is provided. 
[0059] 

In table 2, "power save mode" corresponds to the mode in 
which the power consumption is reduced. In this mode, for 
example in the case of the foregoing application for the TV phone, an 
internal clock in the scaler 201 and the image codec 202 is slowed 
down so that a frame rate of the transmitted image becomes 1/2. 
[0060] 
[Table 2] 



OPERATION MODE 


POWER CONSUMPTION 


IDLING (APPLICATION UN ACTIVATED) 


0.1 mW 


POWER SAVE MODE 


200 mW 


FULL POWER MODE 


300 mW 



[0061] 

When the user performs the manipulation for activating an 
application (step S6), the application is activated through the 
foregoing process (step S7). The system controller 3 monitors the 
insertion status of the audio/image processor 2 while no application 
is being executed, as in the steps SI, S2 (steps S8, S9), and turns 
off the power supply (step S10) and deletes the application (step 
Sll), upon detecting that the audio/image processor 2 is removed. 
[0062] 

The system controller 3 is constantly monitoring the power of 
the device, while the device is at work. The monitoring may be 
performed by known techniques including, as a typical example, 
deciding a total capacity on the basis of a type of a battery loaded in 
the device, and monitoring a voltage of the battery and a 
corresponding operation mode of the device while the device is at 
work, thereby estimating a remaining capacity of the battery. 

DRAWINGS <EXCERPT> 



[Fig. l] 




2 AUDIO/IMAGE PROCESSOR 

3 SYSTEM CONTROLLER 

4 MICROPHONE 

5 SOUND INPUT CONTROLLER 

6 SOUND OUTPUT CONTROLLER 

7 SPEAKER 

8 IMAGE PICKUP UNIT 

9 IMAGING PROCESSOR 

10 IMAGING CONTROLLER 

11 DISPLAY CONTROLLER 

12 LCD 

13 HARD KEY INTERFACE UNIT 



[Fig. 2] 



-8- 













5 










: I 1 







I . . I, 



101 
102 
103 



IMAGE CODEC 

RECORDING MEDIUM INTERFACE UNIT 
RECORDING MEDIUM 



[Fig. 3] 
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[Fig. 4] 
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51 READ INSERTION STATUS 

52 INSERTED? 

53 POWER SUPPLY ON 

54 READ FIRMWARE 

55 ADD APPLICATION 

56 APPLICATION ACTIVATED? 

57 EXECUTE APPLICATION 

58 READ INSERTION STATUS 

59 INSERTED? 

510 POWER SUPPLY OFF 

511 DELETE APPLICATION 
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PROBLEM TO BE SOLVED: To obtain a multimedia 
terminal device with more efficient hardware 
configuration and software configuration. 
SOLUTION: The multimedia terminal device comprises a 
device body 1, an image/voice-processing section 2 that 
is composed detachably, and a system control section 3 
consisting of a CPU, a memory, a timer, and the like that 
are provided for controlling the entire device. The 
multimedia terminal device 1 comprises a signal- 
processing section for converting an image signal for 
indicating the object image that has been picked up by 
picking up the object image to digital image data, and a 
signal-processing section for performing signal 
processing to the digital image data. The image/voice- 
processing section 2 is composed so that it can be 
attached to or detached from the multimedia terminal 
device body 1, and a plurality of different signal 
processing can be executed by exchanging the signal 
processing section. As a result, a diversified application 
can be realized by the same image-inputting device. 
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